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DETAILED ACTION 
Claim Rejections - 35 USC §112 

1 . The following is a quotation of the second paragraph of 35 U.S.C. 112: 

The specification shall conclude with one or more claims particularly pointing out and distinctly 
claiming the subject matter which the applicant regards as his invention. 

2. Claims 13-16, 23-28, 41-44, 51-56 are rejected under 35 U.S.C. 112, second 
paragraph, as being indefinite for failing to particularly point out and distinctly claim the 
subject matter which applicant regards as the invention. 

Claim 13 recites "A method for demultiplexing an image stream having a plurality 
of images...", which implies the image stream is a "multiplexed" image stream 
comprising a plurality of images from a plurality of image sources. However, the claim 
as a whole, fails to suggest a "multiplexed" image stream or at the least, an image 
stream comprising a plurality of images from different sources. 

Claim 41 is rejected for similar problems as specified in claim 13. 

For the purpose of art consideration, "an image stream" as claimed is construed 
as a multiplexed image stream. 

Claim Rejections - 35 USC § 101 

3. 35 U.S.C. 101 reads as follows: 

Whoever invents or discovers any new and useful process, machine, manufacture, or composition of 
matter, or any new and useful improvement thereof, may obtain a patent therefor, subject to the 
conditions and requirements of this title. 

4. Claims (29-40, 45-50) and (41-44, 51-56) are rejected under 35 U.S.C. 101 
because the claimed invention is directed to non-statutory subject matter. 
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Independent claim 29 recites "a computer program product" that fails to meet the 
statutory requirement set forth in the Interim Guidelines. Annex IV (a) . The computer 
program product has to be embodied in a computer-readable media. Claim 29 fails to 
recite this aspect. Claims 30-40 and 45-50 depend on claim 29. 

(a) Functional Descriptive Material: "Data Structures" Representing 
Descriptive Material Per Se or Computer Programs Representing 
Computer Listings Per Se 

Data structures not claimed as embodied in computer-readable media are descriptive 
material per se and are not statutory because they are not capable of causing functional 
change in the computer. 

Independent claim 41 is rejected for similar problem as stated in claim 29. Claims 
42-44 and 51-56 depend on claim 41 . 



Claim Rejections - 35 USC § 102 

5. The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that 
form the basis for the rejections under this section made in this Office action: 
A person shall be entitled to a patent unless - 

(a) the Invention was known or used by others in this country, or patented or described in a printed 
publication in this or a foreign country, before the invention thereof by the applicant for a patent. • 

(b) the invention was patented or described in a printed publication in this or a foreign country or in public 
use or on sale in this country, more than one year prior to the date of application for patent in the United 
States. 

(e) the invention was described in (1) an application for patent, published under section 122(b), 
by another filed in the United States before the invention by the applicant for patent or (2) a 
patent granted on an application for patent by another filed in the United States before the 
invention by the applicant for patent, except that an international application filed under the 
treaty defined in section 351(a) shall have the effects for purposes of this subsection of an 
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application filed in the United States only if the international application designated the United 
States and was published under Article 21(2) of such treaty in the English language. 

6. Claims 1-6, 8-9, 11-14, 16, 21, 28-34, 36-37, 39-42, 44, 49, 56 are rejected under 
35 U.S.C. 102(e) as being anticipated by Steven G. Goodridge, "Content-based 
software demultiplexing of surveillance video", Proc. SPIE Vol. 4232, p. 513-520, 
February/2001 (hereinafter, "Goodridge"). 

Re claim 1 , Goodridge discloses a method for demultiplexing video images in a 
video stream (Abstract), the video images produced by a plurality of cameras (Abstract, 
Introduction, which discuss multiplexed video stream from different cameras), the 
method comprising: 

receiving at least a portion of the video stream composed of a plurality of video 
images in a processor (section 2: Problem Formulation, which discusses software 
based demultiplexing of multiplexed video sequence. Thus, the step of "receiving" the 
multiplexed video sequence is inherent as well as a processor because of software 
implementation); 

parsing a first video image from the video stream (section 2: Problem 
Formulation, which discusses "extracting" one camera view at a time from the 
multiplexed video sequence); 

parsing a second video image from the video stream (section 2: Problem 
Formulation, which discusses "extracting" one camera view at a time from the 
multiplexed video sequence); 
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determining an amount of mismatch between the first and second video image 
(sections 2-3, which discuss a measure of "similarity" of image view(s) between images 
from the multiplexed video sequence. The similarity is based on difference histograms 
representative of mismatch between two video images); 

if the mismatch is below a mismatch threshold, assigning the first and second 
video images to a first channel (sections 2-4, which also discuss that if the "similarity" 
based on the difference metrics is below a preset threshold, chances are the images 
originated from the same camera i.e. from the same channel). 

Re claim 2, which further recites "wherein the first channel includes a memory 
storage location for storing video images", in Goodridge (Abstract, section 1, fig: 1), the 
channels are the plural cameras for capturing image views. Hence, these cameras 
have storage capability for video surveillance application. 

Re claim 3, which further recites "wherein the first channel is associated with a 
first camera" (see discussion in claim 2, see fig. 1, which illustrates respective channel 
views for respective cameras). 

Re claim 4, which further recites "wherein if the mismatch is above a mismatch 
threshold, assigning the first video image to a first channel and the second video image 
to a second channel", Goodridge also discloses this aspect (sections 2-4, which also 
discuss that if the "similarity" based on the difference metrics is above a preset 
threshold, chances are a new shot has been detected from a different camera. Thus, 
these shot(s) are "classified" to respective camera(s) i.e., channel(s) for display). 
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Re claim 5, which further recites "wherein the second channel is associated with 
a second camera", see discussion in claim 3 above. 

Re claim 6, which further recites "wherein after each channel associated with a 
camera has been assigned a video image, comparing a new video image from the video 
stream with at least one video image from each channel; determining an amount of 
mismatch between the new video image and the at least one video image from each 
channel; and assigning the new video image to a channel having the lowest mismatch", 
in Goodridge (sections 2-4), the algorithm for computing difference metrics is 
continuous for "all" images in the multiplexed video sequence in order for the respective 
camera(s) i.e., channel(s) are properly assigned or classified. See also discussions in 
claims 1-4 above. 

Re claim 8, which further recites "comparing a third video image to the first and 
the second video images to determine a first and a second mismatch; if the first and 
second mismatches are above a mismatch threshold assigning the third video image to 
a third channel", this aspect has been considered and rejected w/r to claims 1 , 4 and 6 
above. 

Re claim 9, which further recites "comparing a third video image to the first and 
the second video images to determine a first and a second mismatch; if the first 
mismatch and second mismatches are below a mismatch threshold, assigning the third 
video image to the channel associated with the lower mismatch", this aspect has been 
considered and rejected w/r to claims 1, 4 and 6 above. In Goodridge (sections 2-5), 
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threshold can be varied to take into account different similarity metrics so that channel 
classification is properly assigned. 

Re claim 1 1 , which further recites "wherein each channel is associated with a 
camera", see analysis and rejection w/rto claims 1-4 above. 

Re claim 12, which further recites "providing the number of cameras to the 
processor", see analysis and rejection w/r to claims 1-4 above (Goodridge pertains to a 
software based demultiplexing of multiplexed video sequence originiated from plural 
cameras). 

Claim 13 recites "A method for demultiplexing an image stream having a plurality 
of images, the method comprising: comparing each new image within the image stream 
to a representative image associated with a camera to determine a mismatch value; if 
each of the mismatch values are above a mismatch threshold, associating the new 
image with a new camera". The claimed limitations have been analyzed and rejected 
w/rto claim 1 above. In regards to "a representative image" as further recited in claim 
13, Goodridge teaches this aspect through a "reference image adaptation" (section 6). 
A reference in^age in Goodridge serves as a representative image as claimed. 

Re claim 14, which further recites "wherein if any of the mismatch values are 
below the mismatch threshold, selecting the lowest mismatch value and associating the 
new video image with the camera associated with the lowest mismatch value", this 
aspect has been considered and rejected w/rto claim 6 above. 

Re claim 16, which further recites "wherein after a predetermined number of 
video images are assigned to a particular camera, the total number of cameras can be 
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determined", Goodridge also teaches this aspect (section 2). In this section, a measure 
of similarity is ascertained in order to classify images belonging to a view V| or to a 
different view. Hence, this classification can determine the total number of cameras 
based on a camera view Vj, being a member of the set e{\A|, V 2 , V N }, where N is 
unknown. 

Re claim 21 , which further recites "providing a user interface for setting the 
mismatch level; receiving user input of the mismatch level", Goodridge further discloses 
this aspect (section 7: Application Integration, also fig. 6 which is an interface to enable 
adjusting difference metric threshold). 

Re claim 28, which further recites "selecting a portion of the reference images to 
be used for comparison to a same portion of the new video image". Goodridge 
discloses this aspect (section 5: Comparison Window Selection). 

Claim 29 pertains to a computer program for executing the method steps of claim 
1 . Thus, it has been analyzed and rejected with respect to claim 1 . Furthermore, 
Goodridge discloses software-based demultiplexing, which inherently necessitates 
executing a computer program. 

Re claim 30, see claim 2. 

Re claim 31 , see claim 3. 

Re claim 32, see claim 4. 

Re claim 33, see claim 5. 

Re claim 34, see claim 6. 

Re claim 36, see claim 8. 
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Re claim 37, see claim 9. 
Re claim 39, see claim 1 1 . 
Re claim 40, see claim 12. 

Re claim 41, see claim 13. Claim 13 pertains to a computer program for 
executing the method steps of claim 13. Thus, it has been analyzed and rejected 
with respect to claim 13. Furthermore, Goodridge discloses software-based 
demultiplexing, which inherently necessitates executing a computer program. 
Re claim 42, see claim 14. 
Re claim 44, see claim 16. 
Re claim 49, see claim 21 . 
Re claim 56, see claim 28. 

Claim Rejections - 35 USC § 103 

7. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 102 of this title, if the differences between the subject matter sought to be patented and the prior art are 
such that the subject matter as a whole would have been obvious at the time the invention was made to a 
person having ordinary skill in the art to which said subject matter pertains. Patentability shall not be negatived 
by the manner in which the invention was made. 

8. Claims 7, 10, 15, 19, 20, 22-25, 35, 38, 43, 47-48, 50-53 are rejected under 35 
U.S.C. 103(a) as being unpatentable over Goodridge as applied to claim 6, 4, 14 above 
respectively, and further in view of Ahmad, US 6,259,817. 

Re claim 7, which further recites "wherein if the lowest mismatch is above a 



discard threshold, then discarding the new video image rather than assigning the new 
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video image to a channel". Goodridge fails to teach this aspect. However, Ahmad does 
(col. 6, line 62-67). Ahmad teaches this to discount miniscule changes between 
images, which often implies similar or same images of a scene. Thus, no additional 
memory is necessary when a new video image is discarded. 

Therefore, taking the combined teaching of Goodridge and Ahmad as a whole, it 
would have been obvious to one of ordinary skills in the to utilize frame discarding in 
order to efficiently utilized memory capacity. 

Re claim 10, which further recites "comparing a third video image to the first and 
the second video images to determine a first and second mismatch; if both the first and 
the second mismatches are above a discard threshold, discarding the third video 
image", this aspect has been considered and rejected w/r to claims 1 , 4, 6, and 7 above. 

Re claim 15, which further recites "wherein if the mismatch values are all above a 
discard level, discarding the new video image", this aspect has been considered and 
rejected w/r to claim 7 above. 

Re claim 19, which further recites, "wherein the first video image and the second 
video image are sub-sampled prior to comparison". Goodridge does not explicitly use 
the term subsampling per se. However, such technique is implied in Goodridge. For 
example, Goodridge suggests comparing only a "portion" of an image view (section 5: 
Comparison Window Selection). In order to compare a portion of an image view, 
subsampling would have been necessitated to extract said portion. 

Re claim 20, which further recites "wherein if the video image stream contains 
header information, discarding the header information". This aspect is implied through 
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the discussion of claim 7 above. That is, header information associated with an image 
destined to be discarded will too be discarded. Furthermore, in Goodridge, since 
demultiplexing is carried out through content-based image comparison as opposed to 
conventional image identification through header information, discarding header 
information would be have been obvious and expected because there is no need for 
such information. 

Re claim 22, which further recites "providing a user interface for setting the 
discard level; receiving user input of the discard level". With reference to the discussion 
of claims 7 and 20 above, the combination of Goodridge and Ahmad as a whole would 
have obviated the motivation to discard video image, and a user interface to set various 
thresholds, including discard threshold(s). 

Re claim 23, which further recites "allowing a user to assign a video image to a 
camera even though the mismatch is above the discard error level". With reference to 
the discussion of claims 7 and 20 above, the combination of Goodridge and Ahmad as a 
whole would have obviated the motivation for a user to use the interface not only to set 
various thresholds, including discard threshold(s), but to also subjectively assign 
camera to his choosing. Such capability is implied and necessitated through the user 
interface (Goodridge, fig. 6). 

Re claim 24, which further recites "wherein a user may select video images to 
discard prior to comparison". With reference to the discussion of claims 7 and 20 
above, the combination of Goodridge and Ahmad as a whole would have obviated the 
motivation for a user to use the interface not only to set various thresholds, including 
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discard threshold(s), but to also to subjectively select which image(s) to be discarded 
prior to image comparison. Such capability is implied and necessitated through the user 
interface (Goodridge, fig. 6). 

Re claim 25, which further recites "the method according to claim 15, wherein if a 
video image is associated with a camera and a new video image is also associated with 
the camera, the new video image becomes the reference image for all further 
comparisons", Goodridge teaches this aspect (section 6: Reference Image Adaptation). 

Re claim 35, see claim 7. Claim 35 pertains to a computer program for executing 
the method steps of claim 7. Thus, it has been analyzed and rejected with respect to 
claim 7. Furthermore, Goodridge discloses software-based demultiplexing, which 
inherently necessitates executing a computer program. 

Re claim 38, see claim 10. 

Re claim 43, see claim 15. 

Re claim 47, see claim 19. 

Re claim 48, see claim 20. 

Re claim 50, see claim 22. 

Re claim 51 , see claim 23. 

Re claim 52, see claim 24. 

Re claim 53, see claim 25. 

9. Claims 26-27, 54-55 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Goodridge. 
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Re claim 26, which further recites "the method according to claim 13, wherein a 
user may clear all reference images and begin the process of assigning a video image 
to each camera images". Although Goodridge is silent on this aspect, such capability is 
implied and necessitated through the user interface (Goodridge, fig. 6, sections 6-7). In 
Goodridge, the user interface would have obviated the motivation to subjectively clear 
all reference images and to begin camera assignment to each camera images, 
especially for CCTV video surveillance application. 

Re claim 27, which further recites "the method according to claim 26, further 
comprising: automatically adjusting brightness within the reference video images and 
the new video image so that brightness levels are substantially similar prior to 
comparison. Although Goodridge is silent on this aspect, such capability is implied and 
necessitated through the user interface (Goodridge, fig. 6, sections 6-7, e.g., "video 
renderer"). 

Re claim 54, which pertains to a computer program for executing the method 
steps of claim 26. Thus, it has been analyzed and rejected with respect to claim 26. 
Furthermore, Goodridge discloses software-based demultiplexing, which inherently 
necessitates executing a computer program. 

Re claim 55, which pertains to a computer program for executing the method 
steps of claim 27. Thus, it has been analyzed and rejected with respect to claim 27. 
Furthermore, Goodridge discloses software-based demultiplexing, which inherently 
necessitates executing a computer program. 
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10. Claims 17-18 and 45-46 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Goodridge as applied to claims 1 and 29 above respectively, 
and further in view of Guichard et al, "Software-based Universal De-multiplexing", 
Proceedings of SPIE, Vol. 4232, February/2001 (hereinafter, "Guichard"). 

Re claim 17, which further recites "wherein channel assignment is performed in 
real-time", Goodridge teaches a configuration (fig. 1) for video surveillance that appears 
to be real-time, but not specifically disclosed. However, Guichard does (section 4: 
Conclusion), which summarizes the algorithm for real-time de-multiplexing system in 
order to de-multiplex a live feed of multiplexed video. 

Therefore, taking the combined teaching of Goodridge and Guichard as a whole, 
it would have been obvious to incorporate real-time demultiplexing in order to de- 
multiplex a live feed of multiplexed video, especially for law enforcement purposes 
(Guichard, section 4). 

Re claim 18, which further recites "wherein the digital image stream is parsed 
and the video images are assigned to a channel in real-time", this aspect has been 
considered and rejected w/r to claim 17 above. It is noted that video-based 
demultiplexing as taught in Goodridge and Guichard involves "parsing" video images 
from the multiplexed video stream. 

Re claim 45, see claim 17. Claim 45 pertains to a computer program for 
executing the method steps of claim 17. Thus, it has been analyzed and rejected with 
respect to claim 17. Furthermore, Goodridge discloses software-based demultiplexing, 
which necessitates executing a computer program. 
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Re claim 46, see claim 18. 
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